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I. INTRODUCTION 


A. BACKGROUND 

The rapid installation of powerful microcomputers increases productivity. Increasing 
the productivity of people who use these machines is important too. Analysts have 
estimated that, in over 95 percent of human-computer interactions, labor costs are greater 
than the machine costs [INFOTECH79]. Thus, user-friendliness of an interface is the key 
issue. 

Research in voice recognition (VR) systems has been ongoing for over 30 years. 
Already many applications use voice input to computer systems. The development of the 
bar code industry from the perspective of industrial application, which began in the early 
1970s, moved from the laboratory into a significant part of American and International 
business and industry, promises more innovative and broadly-based applications in the 
future. In addition, the development of Database Management Systems manages databases 
and enables end-users to interact with the data. Finally, the development of different types 
of scanners enables users to enter any document into databases with minimum effort. 
Although most organizations own powerful microcomputers, their personnel still do a lot 


of work manually. 


B. THE EXISTING PROBLEMS 

In every organization there are some areas where entrance is only allowed to 
authorized persons; such as Communication Centers, Ammunition Stores in military bases, 
Customer Service Stores and Laboratories. For these areas it is necessary to check the 
entrance/exit of every person, verify his/her ID, check the time of entry/exit, note the 
duration of all visits, and finally store all information. In the past, this process has been 
done by security guards, who simply check the visitor’s ID card. Howe Ent accomplish 
a good security level, an authorized person is provided with an ID that contains alot of 
confidential information (Photo, Rank, Person’s record, Person’s duty in the area, etc). In 
such a way, Security guards are able to have the overall picture of the visitor and check 
information easily. Unfortunately, the loss of such an ID might provide an unauthorized 
person with confidential information, which would create security problems. 

In addition, in many organizations there are departments/equipments that must be 
checked at regular time intervals. Areas such as ammunition stores, engine rooms of a 
ship, hold of a ship, research laboratories, and nuclear factories are checked by specific 
safety guards, for safety purposes. Until now, this check has been done manually by 
safety guards at on a fixed period of time; using physical keys. The safety guard keeps 
a Clock-counter and visits each department at regular intervals of time. In every 
department, using the physical key, he stores the department ID and time of check on a 
paper strip inside the clock-counter. The next day the control officer takes out the paper 
strip, checks all the key inputs to see if the safety guards have done their job correctly, 


and stores the information. 


Is there a way, to improve these manual check security/safety systems, using the 


existing microcomputers? 


C. A POSSIBLE SOLUTION 
A possible solution to the previous problem is the use of a multimedia Database 
Management System (MDBMS) which would enable end-users to interact with all 


different kinds of data concurrently. A multimedia DBMS which can manipulate: 


* formatted data (i.e., all the data types supported by a traditional DBMS) 
e images (ex., person’s photo, equipments’ photo) 

¢ graphics (ex., departments’ drawing) 

* voice recognition systems 


* bar codes 


By definition a multimedia Database Management System is the DBMS [LUM88], 


[LUMS9] that can manipulate data such as: 


* formatted data 
* images 
* graphics 


* Sound (ex., a sample of person's voice) 


The first approach of MDBMS definition differs slightly from the second approach. 


The first approach does not contain the item sound, but it contains two new items; voice 


recognition system and bar codes. However, that isn’t a significant problem, since a 
multimedia DBMS for a specific application does not need to manipulate all of the 
previously referred items necessarily. Moreover, the bar code input can be viewed from 
two different perspectives. One as a means to enter data into computers (1.e., input data 
device); two the entered data defines some value of a records’ attribute, which uniquely 
identifies the associated record (ex., person’s ID). Thus, bar codes can be considered to 
be a part of formatted data for the needs of DBMS. The voice recognition system 1s also 
an input device. But it differs significantly from the traditional input devices, since the 
input is the user's voice which, after it is interpreted, is converted to specific commands 
that the computer has to execute. Since these commands are related to the DBMS, a 


MDBMS has to consider this kind of input too. 


D. A BETTER SOLUTION 

Of course, the previous approach is possible, but it seems to have disadvantages. 
First we need to have a multimedia DBMS which would manage the previously referred 
data, that is not presently available. Moreover, the design and implementation of such 
multimedia DBMS might need a specific system on which it is run. That creates the 
problem of not using the existing microcomputers and significantly raises the overall cost. 

To solve the problem described in the previous paragraph, by exploiting the existing 
microcomputers at organizations, we can develop a prototype application combining 
dBASE III PLUS, ToolBook, MS Windows, a Voice Recognition Input System, a 


Scanner, and a Bar Coding System. This prototype, Control Command Check System 


(CCCS) provides a better security/safety level, and is easy to use due to the well designed 


graphical user interface. 


E. OUTLINE 
This research will present one major topic per chapter. The major objectives of this 
thesis are: 
* how we implement a multimedia DBMS that manipulates data of traditional 
databases, scanned photographs, voice inputs and bar coding inputs; 


* how such a system could be implemented on the IBM compatible personal 
computer, using existing commercial software; 


* how this system could satisfy both novice and experts users; and 


* how such a system improves the security/safety level; 


These issues will be discussed together with a detailed description of the prototype 
developed for this research. The thesis is organized as follows: 

Chapter II contains the related literature. It introduces bar codes, voice recognition 
systems and the software environment that will be used for the application. First, besides 
the basic description of bar coding, it also provides a brief comparison to other types of 
machine-readable labels. Second, it introduces speech, categories of speech recognizer and 
speech applications. Finally, it discusses the main software packages that will be used to 
create the prototype software environment, such as MS Windows 3.0, ToolBook and 


dBASE III PLUS. 


Chapter III describes how the designed prototype, Control Command Check : 
System, accomplishes the previous objectives. Specific constraints of this application and 
whom it is designed for are also discussed. 

Chapter IV discusses the prototype application Control Command Check System. 
It provides detailed descriptions of the user’s environment, presents all the types of 
screens, and explains how users can navigate through the CCCS and exploit all the 
provided capabilities. 

Chapter V contains the results of this research, examines if the goals, we originally 
defined, are accomplished, and discusses the performance the CCCS achieves. Issues such 
as memory space, CPU speed, and environment requirements are discussed too. 

Finally, Chapter VI addresses the areas of this thesis for improvement and the areas 


for future research. 


II. LITERATURE 


A. BAR CODES 

A bar code is a printable machine language. In fact, bar codes are the only printable 
machine language which reproduces directly the bit-stream of ones and zeros which are 
the basis for the internal logic of all digital computers. They are messages where 
information is encoded using the widths of printed bars, the widths of spaces between 
bars and the relative positions of wide or narrow bars and spaces (i.e., unique wide or 
narrow combinations of black and white bars). They provide a means of creating labels 
which can be read by instruments. 

Bar coding is a memory form. Printing black bars on white paper is directly 
analogous to recording plus or minus bars in a magnetic medium. In fact, the basic 
formats used in these two technologies are identical. While information recorded in 
magnetic media can be packed at higher densities, and can be erased and recorded, 
printing bar codes on plain paper is much less expensive for many memory applications. 

Bar coding is a communication technique. Just as printed documents function as a 
basic means of communication between human minds, so bar-coded documents can link 
widely distributed instruments of diverse kinds into inexpensive communication networks. 

Bar coding involves four independent but interrelated processes: printing; reading; 
transforming from the space phase (what is printed) to a time phase, followed by an 


algorithm to decode the time phase; and a coding scheme which facilitates all the other 


processes. Existing commercial devices introduce major variables into each of these 
processes. 

In one common practice, humans examine each passing item, then communicate 
their observation to computers via manually operated keyboards; skilled typists can enter 
messages at arate of four to six characters per second. As an alternative, where each item 
is made identifiable by a machine-readable label, that label is read automatically at each 
system node, key entry is bypassed, and computers receive accurate — in less 
time and at lower cost. 

With bar-code label, relatively unskilled individuals using hand held bar-code wands 
can achieve a data entry rate of at least twenty characters per second with one fluid 
movement of the hand. But perhaps of more importance than speed is accuracy. Therefore 
an automated item-identification scheme is the basis for maximizing the effectiveness of 
database management systems. 

There are three basic types of machine-readable labels now under consideration for 
discrete-manufacture applications [BURKES4]: optical character recognition (OCR), 
magnetic strip and bar code. Optical character recognition is the ability of an instrument 
to recognize or read human-readable characters. 

Of the three types listed, magnetic strip and OCR are definitely restricted in their 
capabilities; only bar coding can be used as a generally applied labeling technique. 
According to the published literature, OCR substitution error is 1/10,000 for restricted 


character set. This in itself is so bad that a full character set is seldom attempted. 


Generally, the advantages and disadvantages for each label technique are presented in 


figure 2.1 [BURKE84]. 


BAR CODE READING OPTICAL CHARACTER RECOGNITION MAGNETIC STRIPE READING 
ADVANTAGES 


- EASY TO PRINT - HUMAN READABLE - READ-WRITE CAPABILITY 
- INEXPENSIVE MEDIA - EASY TO PRINT - LOW ERROR RATE 

- EASY TO COPY - EASY TO COPY - NON-CRITICAL WANDING 
- NON-RESTRICTED FORMAT - WORD PROCESSING COMPATIBLE - FULL CHARACTER SET 

- WORD PROCESSING COMPATIBLE - HIGH INFORMATION DENSITY 

- INEXPENSIVE TO READ 

- LOW ERROR RATE 

- HIGH SPEED PRINTABLE 

- NON-CRITICAL WANDING 

- MATERIAL IMPRINTABLE 

- FULL CHARACTER SET 

- BEAM SCANNABLE 


DISADVANTAGES 


- LOW INFORMATION DENSITY - EXPENSIVE TO READ - EXPENSIVE MEDIA 
- ORIENTATION CRITICAL - NOT HUMAN READABLE 
- RESTRICTED WANDING SPEED - MODIFIABLE 
- RESTRICTED CHARACTER SET - WORD PROCESSING INCOMPATIBLE 
- HIGH ERROR RATE - DIFFICULT TO COPY 
- LOW THROUGHPUT - RESTRICTED ಎ 
- NOT BEAM SCANNABLE - LOW PRINT RA 
- NOT READ THROUGH PLASTIC COVER 


- NOT BEAM SCANNABLE 





Figure 2.1 Advantages/Disadvantages of Label Techniques 

Security, machine-readability, and various levels of user sophistication (and lack 
thereof) coalesce in a requirement for an inexpensive technique which can be used to 
prepare documents carrying messages. Application include amusement park passes, 
garment tags, electronic hotel keys, transportation vouchers, ID cards and the like 
[COE84], [LOEFFIER84]. In most applications, bar coding offers a much simpler answer 


with more read reliability at lower document cost. 


B. VOICE RECOGNITION SYSTEMS 


1. Speech Composition 
Human speech is a complex, well-defined process of conveying information. 
The process starts with the brain, which sends signals to those muscles and organs used 
to make speech. The formation of speech sounds then occurs and the process ends with 
interpretation by the listener. This section will provide a basic foundation for 
understanding the way speech is formed, the composition of speech signal, and the 
information components of speech. 
The physical process of communicating is achieved by the interaction of lips, 
tongue, and teeth. Five types of speech sounds articulated in English are [Jensen88]: 
¢ Plosives which are sounds created by stopping the passage of air. An example is 
the letter "t" in the word "top". 


* Fricatives are caused by forming a narrow passage through which air may pass. 
The diphthong "th" in the word "their" is an example. 


* Laterals are sounds formed when the tongue touches the roof of the mouth. An 
example is the "]" in "launch". 


¢ Trills are caused by the rapid vibration of one of the articulators (lips, tongue, etc). 
The letter "r" is a trill sound in some languages. 


e Vowels are those sounds made when unobstructed air passes over the vocal cords. 


Human speech, then, consists of strings of phonemes, which are the atomic 
units of sound. Most spoken languages require between twenty and sixty phonemes 
[Lea80]. Analysis of the phonemes required for a word viewed in isolation is not 


sufficient because words sounds change depending upon the location within a string of 
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words. A language’s phonological rules govern the phonemes associated with a specific 
word depending upon other sounds immediately preceding and following the word. 

Speech understanding is not based on word alone. Understanding requires not 
only knowledge about what was said but also how it was said. Hearing phonemes is the 
basis for what was said. Interpreting the stress, tempo, placement, and duration of pause 
and intonation implies how it was spoken. This process is termed prosodics. An example 
would be understanding the implication of the following sentences: 

"I can see a head." vs "I can see ahead." 

The sentences contain identical sounds, yet the prosodics of speech avoids the obvious 
ambiguity caused if pauses were not considered in the interpretation of what was said. 
Frequently though, prosodics alone is insufficient for understanding, as in the case of poor 
enunciation. Resolution of ambiguity may also involve an understanding of context in 
which a phrase was spoken, which is the term pragmatics. 

Human speech is also governed by a structure we know as grammar. The 
grammatical structure is represented by syntax. English syntax, for example, requires a 
proper sentence to be composed of a noun and a verb phrase. The syntactic rules, in 
conjunction with prosodics, govern how an utterance may correctly spoken. 
Linguistictheory suggests the more complex the syntactic constructs, the more powerful 
the language. 

The human process, then, of semantic analysis of speech is reliant upon not 


only hearing the strings of phonemes but also using the prosodics, pragmatics, and syntax 
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of the language in order to understand not only what was said but what was meant. This : 
ability allows us to uniquely process phrases such as “up in arms" and "over the hill”. 
Depending upon the application, speech systems may offer varying degrees of 
sophistication-from the simple phoneme interpreter (an isolated word recognizer) to a 
system capable of resolving prosodic and semantic ambiguity (a natural language 


processor). 


2. Speech Analysis 

Understanding how speech is analyzed by a machine is simplified by 
developing parallels between the more familiar human process and the unfamiliar machine 
process. A Knowledge Source is the relative maturity of the system, human or machine. 
Just as children can be "programmed" to understand, so can a machine. The sophistication 
or robustness of speech analyzer then is directly related to its ability to process the variety 
of speech information (phonological rules, prosodics, syntax, and pragmatics). 

A fundamental algorithm for understanding what was said is found in figure 
2.1 [REDD Y76]. This is a classic speech signal analysis algorithm that most processors 
use, regardless of the technology involved. Conversion of the human analog signal to a 
discrete digital signal in a machine-acceptable format is the first converter, an attempt is 
made to bound the signal. Accurate detection of the boundaries of a signal is essential if 
recognition is to be achieved. Because the entire spectrum of the signal may not be 
required, an algorithm is employed to isolate the essential signal characteristics. The 
remainder of the signal is discarded in a process known as data compression. The 


probability that two utterances of a word or phrase are identical is remote. All recognizer, 
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then, must be capable of eliminating slight variances in speech, pitch, intonation, and 
pause length. The filtering or "normalizing" process allows for a range of signal 
variability. The more robust the recognizer, the greater the variance. Depending upon the 
mode (learning or recognition), an attempt is made to either add the signal to a 
vocabulary or match the sound against an existing vocabulary. 

Algorithms used to match the signal have been a major research area, while 
increasing both speed and accuracy is a primary goal. Generally, though, matching is 


achieved by comparing distances between the incoming pattern and some previously 


stored reference pattern. The pattern with the minimum distance is judged the winner. 






A to D conversion 









End Point Detection 


Data Compression 







Normalization 


Add to Vocabulary Time Alignment--Compare 


Figure 2.2 Speech Recognition Components 
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3. Categories Of Recognizer 

Research and commercial endeavors have combined to develop a variety of 
recognizer, which are designed to satisfy specific application requirements. Two points 
to understand when evaluating any speech recognition system are the degree of speaker 
independence and how utterances are parsed. 

Speech systems today are either speaker independent or speaker dependent. 
The more common, speaker dependent systems require the user to pre-train the system 
prior to use. Training typically involves creating a personal template for each word in the 
vocabulary. Creating a personal speech template for each word in the vocabulary ensures 
consistent input will be acceptable regardless of individual speaker characteristics. 
Unfortunately, for connected speech systems with large vocabularies, this could become 
a time-consuming process. Speaker independent systems employ a standard template 
against which all speech is compared. The cost is generally a more restricted vocabulary 
and lower overall recognition rates. 

Utterance parsing governs how the recognizer algorithm will dissect the 
utterance. In isolated systems the recognizer has no syntactic knowledge source, thus each 
utterance is viewed singularly. Examples would be commands "ENTER" or "DIAL". 
Short macro phrases are also possible in isolated systems. For example, a recognizer 
could train to recognize and subsequently execute the command "DIAL HOME". 
Connected systems, however, view the speech in terms of a syntax, thus strings of 


commands/words may be spoken in a connected pseudo-language that is a subset of a true 
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language (e.g. English) for a particular environment. An example might be the command 
"DIAL PULSE FOUR ZERO EIGHT FIVE FIVE FIVE ONE THREE TWO LOG IN 
GUEST". An extended variant of connected systems are those that recognize in a 
continuous fashion, typically according to some natural language syntax. Speech-to-text 
applications typically employ a continuous recognizer. As a general rule, the more 


powerful and complete the syntax is, the more natural the interface will be. 
4. Speech Applications 


a. General 

A parallel may be drawn between the development of telegraph/telephone 
systems and computers in general. The discovereeg by A.G.Bell that speech could also 
be transmitted via wire caused the replacement of a keyboard with a voice-actuated 
receiver/transmitter as the primary means of transmitting short duration messages. Why 
did that occur? The primary reason is that despite our sophistication, voice remains our 
most natural communication medium. Keyboards are an outgrowth of the typewriter and 
telegraph technologies but they, too, are limited by the skills of the operator. 

Numerous studies have shown that voice recognition systems are faster 
and more accurate than most manual-entry systems. Additionally, voice systems free the 


operator's eyes and hands to accomplish concurrent tasks [WOODARD83]. 


b. Commercial Applications 
With the increasing sophistication and decreasing cost, commercial 


applications of speech systems have surfaced. The variety of applications is only limited 


Is 


by the imagination. But in the commercial environment, voice input is generally being 
used for one primary purpose: to increase individual productivity. A typical commercial 
speech application is in the area of quality control and inspection. Other commercial 
applications that have been successfully installed include: voice applications of process 
control, warehousing functions, automated material handling, and parts programming for 


machine tools [MARTIN76]. 


c. Military Applications 
The employment of speech in a number of mission-critical military 
systems has increased dramatically in the last decade. Speech recognition research and 
development has been largely supported by military organizations. Military speech 
recognition research efforts have been focused into four primary areas: security, command 
and control (C?), data transmission and communication, and processing distorted speech 


[WOODARDS4], [DRAKE88]. 


C. SOFTWARE ENVIRONMENT 

One major advance in PC technology is the graphical user interface (GUI), which 
Is becoming the standard for today is PC interfaces. The first (in the early 1980s) 
graphical interfaces made computers easier to use because their metaphors and icons 
offered more powerful, flexible, and direct representations of tasks and data than previous, 
character-based systems. They also required high performance processors and high quality 
display hardware. Today, Microsoft Windows, OS/2 Presentation Manager, the Apple 


Macintoch, and other GUI systems deliver similar abilities to the PC users. 


Another major advance in software technology is the development of object-oriented 
programming. Finally Hypertext and Hypermedia represent another new idea for computer 
users. A hypertext author has a strong set of tools for linking related pieces of text and 
graphics with video and sound. By traversing the links an author has created, a reader can 
browse through related information and see conceptual illustrations alongside text. 

An operating environment for IBM and Compatible PCs that has all the previously 
referred features is MS Windows 3.0. In addition many powerful, based on or supporting 


Windows, programs enable users to use PCs more productively. 


1. MS Windows 3.0 

MS Windows 3.0 [WINDOWS90] is a multitasking graphical operating 
environment that makes the use of a PC more productive and more enjoyable. It 
simplifies the operation of every program, makes complex tasks involving several 
programs to seem very simple, and improves the printed output of all user’s work. It also 
allows software developers to build better applications than would develop under 
character-mode DOS. Furthermore, it offers multitasking, a graphical interface, and more 
powerful and flexible applications than the character-mode DOS word does. Finally the 
Dynamic Data Exchange (DDE) feature of Windows permits programs operating under 
Windows to exchange diverse types of data. Any program based on Windows that 
supports DDE can share its information (be in text, data, or graphics) with any other 


DDE-aware program. 
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2. dBASE III PLUS 
It is a remarkably straightforward database system [GBASE86], that provides 
strong support for the user who wants to develop relational database application (although, 
it is not a true relational system). It became the standard for relational databases. Its file 


format is recognized by most of the software application tools. 


3.  ToolBook 
ToolBook [TOOLBOOK90], is an application tool that in cooperation with 
Windows GUI, creates a powerful new metaphor for the PC user. Having the capabilities 
of drawing, database functionality, text manipulation, application programming and other 
features, ToolBook provides the user with flexibility for building solutions to unique 
application needs. By combining easy-to-use programming tools in ToolBook with 
Windows’ graphical text display and ability to control video and sound devices, users are 


able to create hypertext and hypermedia documents. 
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III. THE DEVELOPED MULTIMEDIA PROTOTYPE SYSTEM 


A. PREFACE 


1. The Prototype 
The CONTROL COMMAND CHECK SYSTEM (CCCS) is a software 
prototype package. It has the capability of combining the use of speech recognition, bar 
code scanner, and a database to assist in keeping track of individuals who have access to 
a secure building. 
A command or organization that has to control access to a building can use 
this system to verify that an individual can be granted access. The command or 


organization is responsible for the access records. 


2. End Users 

The system was designed with both novice and expert users in mind 
[SMITH$86] and [SNEIDERMANS7]. It was designed to be used by personnel in entry 
level positions. This includes very junior enlisted personnel, and security clerks/guards 
with basic clerical skills. 

When an individual wants access to the building, he/she presents a card with 
a unique bar code on it (person's ID number) to the guard. The guard will, then, either 
use a scanner that will read the bar code on the card, or enter the individual's ID number 
using the keyboard. The name, rank, social security number (SSN), and any other 


information about that individual will appear on the computer screen. The user has the 


3) 


option of using voice recognition and bar code scanner to input data, or replacing any of 


the two previous means with the combination of keyboard and mouse. 


3. A Graphical User Interface 

Studies have shown [SNEIDERMAN87] that graphical user interface makes 
a substantial difference in learning time, performance speed, error rates and user's 
satisfaction. Of many different approaches tried, the graphical interface has the widest 
acceptance. The graphical interface allows the user to make selections with one keystroke 
or one click on a mouse. In our case, the largest number of users are persons with 
minimal clerical skills, and the rest of them occasional users. The graphical interface, 
therefore, guarantees better results than an interface that requires typing in often cryptic 


and difficult to remember commands. 


4. The Eight Golden Rules Of Dialogue Design 
The system has been designed and implemented following the eight golden 


rules for a good user interface [BROWN89]: 


e Strive for consistency; 

* Enable frequent users to use shortcuts; 
* Offer informative feedback; 

* Design Dialogues to yield closure; 

* Offer simple error handling; 

* Permit easy reversal of actions; 


e Support internal locus of control; and 
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e Reduce short-term memory load. 


B. DESIGNING THE CCCS PROTOTYPE 


1. Three Levels Of System Access 

The CCCS prototype has been designed with three levels of access. The high 
level access is associated with the letter U (real Users), the intermediate level access is 
associated with the letter R (Readers), and the low level access is associated with the 
letter G (Guards). Users in the first category (U) are allowed to enter information into the 
system about individual’s entries/exits, access all the provided information by the system 
(person’s records, user’s records, reports, etc), and maintain the existing databases by 
adding, deleting, updating data. Users in the second category (R) are allowed to enter 
information into the system about individual’s entries/exits, and access some of the 
information provided by the system, in order to check if the security clerks (G) have done 
their job correctly. Finally, guards (G) can only enter information into the system about 
entries/exits. 

The CONTROL COMMAND CHECK SYSTEM offers to users the capability 
of using the system into different ways. First, users of all levels can access and 
manipulate the system using a keyboard, a mouse, a bar code scanner, and speech 
recognition (whether or not the two last input devices are available). Second, the guards 
(G) can also access the system and enter information about entries/exits using only voice 


recognition and bar code scanner. 
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2. Speech Recognition And Bar Code Combination 
The capability of entering data for entries/exits into the system using voice 
recognition input combined with the input of the bar code scanner id offered only to the 
guards (G), figure 3.1. These persons have been considered as having minimal clerical 
skills, and their job is to check the entrance/exit at the secured building entering the 
appropriate information into the system, without having any further access to data. 
Moreover, we don’t want to let them access the data into CCCS (accidently or on 
purpose) by using the keyboard or the mouse. Therefore, the use of speech recognition 
system and bar coding: 
e enables guards to run the prototype with out having to use any of the traditional 
input devices, such as keyboard or mouse. 


* enables guards to enter information about entries/exits and check individual's 
records with just a bar code scanning. 


* provides a higher security level. First by permitting only persons positively voice- 
recognized as guards to access the system and enter data. Second, by not allowing 
guards to access further data of CCCS (they don't have any keyboard or mouse). 

e enables guards to quickly produce productive results with a minimum of training 
time. 

The Real Users (U) and Readers (R) could also start the CCCS execution 
using speech recognition. But, because these users can access more sensitive data and 
procedures in the prototype, there is also a Log-in procedure for them to pass (it consists 


of a LogOn ID number and a password). After a positively recognition, they can gain 


access to CCCS data. This way is also available to all level users for the case of lack of 
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voice recognizer and bar code scanner (or if they are out of order), figure 3.1. This way 
offers the same advantages as previously. Moreover, it improves security by adding one 


more check point (1.e., the Log-in procedure). 


BARCODE BOOK 


WW. 


INTRUDER GET ACCESS 


Figure 3.1 Logic Sequence Accessing CCCS Prototype 





3. The Actual Database 
The CCCS prototype is a multimedia database, and its related ER Diagram 
[ELMASRI89] is shown in figure 3.2. The PERSON tupple is associated with the records 
of individuals who are granted entrance rights to the secured building. The SYSTEM- 


USER tupple is related to the all level users previously mentioned. Since we can not 
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manipulate a photo as a simple attribute of PERSON tupple, we have to produce a distinct * 
tupple for the person’s photograph itself. Each PHOTO instance accompanies the 
respective individual of the PERSON instance. Finally, Persons can enter/exit the building 
and the System-users (all three levels) can register all those information. Besides the 
entry/exit data, the first level System-user can manipulate all the data into the CCCS 
multimedia database, and access any supported report or information (the last capability 


is provided to intermediate level System-users too). 


SYSTEM-USER 


VOICE- COMMAND 


ENTRIES ^N 
UT = eit cS ae 





Figure 3.2 ER Diagram Of CCCS Multimedia Database 
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C. IMPLEMENTING THE PROTOTYPE 


1. The Three Books Of CCCS 
In order to accomplish the predefined goals, the CCCS prototype consists of 


three programs. Each of them is a distinct book in the terminology of Toolbook. 


a. Main Book 
The first book is called "MAINBOOK.TBK" and it can be accessed by 
all users (U,R and G categories). Its primary purpose is to be used by Real Users (U) and 
Readers (R) to manipulate and access data in CCCS. Secondarily, it enables users of the 
three categories to enter data about individual’s entries/exits using the keyboard, mouse 
and bar code scanner (whether or not the last is available). It is allowed to be executed 


by using speech recognized commands, but users must also pass the log-in procedure. 


b. Bar Code Book 

The second book, called "BARCODE.TBK", is for the guards (G) to 
access the system and enter information about entries/exits using only voice recognition 
and bar code scanner. It is a run-time version of the part of the "MAINBOOK.TBK" 
which is related to bar coding. It allows users of G category to enter bar-coded ID 
numbers using the bar code scanner. This way, they verify the individual’s right to access 
the secured building, check that the present person is the same one that referred in the 
database, and update the database of entries/exits. There is not a log-in procedure. Since 
the user can only enter information about entries/exits, without be able to access any other 


data into CCCS, the voice-recognized command to call the program is considered secure 
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enough. Besides, the guards don’t have any other input devices except the voice- 


recognizer and the bar code scanner. 


c. Photo Book 
The last book is called "PHOTO.TBK". It could be considered as a part 
of the person’s database that is used to store and manipulate all the individual’s 
photographs in the PERSON database. This is how we exploit the feature of ToolBook 
to accept and manipulate scanned objects, in order to add person’s photographs producing 


a multimedia database. 


2. Additional Information 

Besides the three books, we need other files to support all the operations the 
CCCS prototype performs. In order to manipulate the PERSONS, SYSTEM-USERS and 
ENTRIES databases, we exploit the feature of ToolBook to recognize/produce/update the 
format and manipulate the data in dBASE III PLUS files. This capability is provided via 
the TBKDB3.DLL library in ToolBook, which allows ToolBook applications to 
communicate and work with dBASE III and dBASE III PLUS files. 

CCCS prototype has also to store intruder’s attempts to break into the system 
and person’s entries/exits history. To accomplish that task, the system uses the 
TBKFILE.DLL library that allows ToolBook to perform some DOS actions from a script. 

Finally, we use the Dynamic Data Exchange (DDE) feature of the MS 
Windows environment to manipulate photograph concurrently with the other person’s 


attributes. Dynamic Data Exchange is a protocol that permits applications running under 
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MS Windows to talk to one another. In such a manner, scripts in "MAINBOOK.TBK" 


and "BARCODE>TBK" send commands to, or get information from the "PHOTO.TBK”. 


D. CONSTRAINTS 


1. Speech Recognition Systems 

The voice recognition is difficult at best with present commercial technology 
for IBM compatibles. In present, the provided commercial systems are speaker-dependent 
isolated systems which function within DOS environment. Therefore, the voice recognized 
commands might be any command that can be recognized and executed by the DOS (1.6., 
DOS commands, batch files, executable files). 

Since the CCCS prototype has been implemented in ToolBook which runs only 
under MS Windows environment, the starting of any of the previous referred books can 
easily be done using a voice recognized command. On the contrary, the ending (Le., 
exiting CCCS) would leave the user within the MS Windows environment. Therefore, a 
new given voice-command will not be executed. In order to use the speech recognition 
systems, we need the CCCS prototype to be called from within DOS environment and 


after its completion to return control back to DOS. 
2. System Hardware/Software Requirements 


a. Microsoft Windows 3.0 
The minimum software and hardware requirements a computer needs to 


run MS Windows 3.0 successfully, referred in [WINDOWS90], are: 
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* MS-DOS or PC-DOS, version 3.1 or later; 


* At least standard mode, a personal computer with 80286 processor or higher and 
1MB or more memory; 


* A hard disk with 6 to 8 MB of free disk space, and at least one floppy disk drive; 
e A monitor that is supported by MS Windows; and 


e A mouse that is supported by MS Windows. 


b. ToolBook 
According [TOOLBOOK89], ToolBook has been designed to work with 
any Microsoft Windows-compatible PC with 80286 or higher processor. Furthermore, the 


minimum system requirements to run ToolBook are: 


e A personal computer with a n 80286 or higher processor; 

* Microsoft Windows version 3.0 or higher; 

* DOS 3.1 or higher; 

* 640KB plus 256KB extended memory (1.5MB memory recommended); 
* One 1.2MB (5!/,") or 720KB (3!/,") disk drive; 

e A hard disk with 2MB to 8MB of free disk space; 

* A monitor and adapter card for VGA, EGA, or Hercules!" graphics; and 


* A Windows-compatible mouse or other pointing device. 
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c. Scanner 
A scanner to enter the photographs of the persons who are granted access 
rights to secured building (ie., individuals in the PERSON database), is needed too. 
Moreover, since the acceptable format of scanned objects within MS Windows 
environment is bitmap, we also need a software package to convert the scanned images, 


from whatever format is, to bitmap. 
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IV. CONTROL COMMAND CHECK SYSTEM 


A. INTRODUCTION 


1. Preface 

The Control Command Check System (CCCS) is a multimedia database 
prototype system. It has the capability to use speech recognition, a bar code scanner, and 
a database to store information (traditional data plus image) about an individual. An 
organization that must control access can use this system to verify authentication. 

CCCS has three access levels. The highest access level is Real Users (U level), 
whose primary job is to maintain the access records in the database. They also have 
access to all operations and data provided by the CCCS (i.e., they are full users of 
CCCS). The intermediate access level is Readers (R level). Readers are granted read-only 
access, not write access. That is, they can access information on an individual in the 
database, but they can not directly access user’s record and they can not modify anything 
in CCCS database. Finally, the third level is Guards (G level); Guards perform entry 
level tasks; such as checking ID’s for Entry and Exit to an organizarion. Additionally, 
they store the entry/exit information in the appropriate files of CCCS. 

There are three books that can be accessed, each for different reasons. The first 
book, MAINBOOK.TBK, is used by Real Users and Readers. It also allows all level users 
to enter entry/exit information. The second book, BARCODE.TBK, is used by guards to 


check individuals for access to an entry/exit point, and then store this information into the 
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system. The third book, PHOTO.TBK, is used as a database to store individual’s images, 
and has the capability to manipulate that kind of data. 

When an individual wants access to the building, he/she presents a card with 
a unique bar code on it to the guard. If a speech recognition system is available, the guard 
enters a voice recognized command. This command executes a DOS batch file which 
activates an MS Windows environment, ToolBook, and loads the "BARCODE.TBK" 
book. The guard uses the scanner to read the bar code on an individual’s ID card. Then, 
the CCCS responses by displaying the individual’s record. If the ID number is valid, 
information of entry/exit is stored in the respective database. However, if the ID number 
is invalid, the CCCS sends a failure message back to the user. 

If a speech recognizer or a bar code scanner is not available, the data has to 
be entered using a keyboard and a mouse. In this case, a voice recognized command 
might be entered, but the loaded book will be the "MainBook.tbk" which contains a log-in 


procedure to allow further access, depending on the user’s access level (U, R, G). 


2. Additional Information 
The following section, Fundamentals, demonstrates how to work with the 
CCCS. It guides the reader navigating via the different screens of the program, and 
explains the displayed menu or submenu functions. Moreover, it describes the features of 
the prototype and what the system requires or accomplishes during each procedure. The 
preliminary work, needed for the manipulation of a person’s photograph in the database, 


is also described. 
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Finally, the last section, Objectives and Goals, examines the CCCS prototype 


system to determine if it has accomplished the original objectives. 


B. FUNDAMENTALS 


The description of the CCCS prototype includes the descriptions of how to work 
with each one of its three books: MainBook, BarCode, and Photo. The descriptions will 


be done via the provided screens of the specific book. 
1. MainBook 


a. Log-On Into MainBook 

After the "MainBook.tbk" has been loaded by a voice recognized 
command or not, the screen shown in figure 4.1 is displayed. The system displays the title 
and the possible combined means in the multimedia database, and offers two choices to 
the user: to log-on into the system, or to exit going back to Windows or DOS 
environment. If the user selects the "EXIT" button, then the system will ask for a 
verification and if the user confirms that it will exit. 

Figure 4.2 presents the starting of the log-in procedure. First, the system 
asks the user to enter his/her logon ID. Then, it requests the password. If the entered 
combination does not exist in the user’s database, the system starts the log-in procedure 
again. If the user fails to enter a correct combination of ID and password three times, the 
System considers that as an intruder’s attempt, stores the ID and password, and returns 


to first page (figure 4.1). 


32 


te 


| 
| 
| 
d 
ಕ 
f 
| 
i 
H 
| 
t 
i 
| 
i 
y 
| 
| 
i 
| 
| 
i 
| 
| 
| 
1 
j 


ES) I a m d e o m a Te ರ ರರು 


` - L7 v 
* &à 9 a & 6 SS 9 v 6 * v 4& V v» 4d € 9) à 9 9» à V à & V  & V 4& V t 4 & V  & v 6 * v 4 * v à 
* 4 e € « 6 € 9 € € 9 € € € * à € * à € & « 9 € « 9 & ಕೈ à € €« 9 € €« 6 € € € ಇ € € & € € à € €* & € € «^ a 6 «^ € 6 4 
- & € * bh € € « € € « € € 4 € € « € € «4 € € € € e € € € € * à € € à € € «^ €& € « 9 € € 4 € & € 
€* 4 e « € 9 e 9 e à € € à * & € v Aà à € « 9 à ಇ. 9 € €  & 4 9 € « € €& € € € € € à 9$ wv si Ones ಇ tea @ 


ro» 
... 
e... 


a 


* € 9 6 € € € 9 € 
* € € € € € € € € € € € 9 9 6 9 


^ 


v» 0,9 6 
ನ್‌ 


[2 
a 
. 


eros 
ees 


e 
. 


€* € € 9 e 9 9 9 e € 9 e 9 «* SA 


ave 
914 


o 
- Fe 
eè t 
oe >? 


g 
in CCCS 


ControlCommandCheckSystem 


9 0” ? o9 ಕೇ e b e * 09 9 6 9 6 6 9 5 0 5 6 6 * * $ BOO oo 


@ee@eteaoee eee Oe eee @ 


MULTIMEDIA SYSTEM 


I 


CONTROL COMMAND AND CHECK 


78007881642 


e. 
ಇ € € € € € € € € 9 € € € * € € € € € € € € 


Ades le Ae De eo hd mal ash d sd ab mda. cua LAAT ab a aaa adm hd m tui m dm d 





irst Screen of Ma 


inBook 


* 


1 F 


4 


Figure 


CNN ENN ENE EN NNN NNN NTN NN 


> - > ೪ > 

ee €" o 9 4 ^ & * 9^ a * 9 À v ^ à * ^ à AE A 4 * t 4À V 5^ 4 € 6 4& ೪ ರ ಯ & v 4 V v à vw à YH 
. * & ^ 9 6 »* € 6 € 9 6 «€ 9 € t * 6€ € 9*0 4099 90464 ಕ ೪6 ಅಆ ೬ ಅ. ಲಜ 9.೪9 ಆ 9೪ ಓ ಳಿ ಈ 9 9 à 9 9 à € * ಹಿ ಕಳಿ ಇ ಳ್ಳಿ ಲ ಇ ಳೆ ಆ 
*» 9 € e 9 * à 9 ಅ & & * à 9 * & 9 v & 9 € * 9 & * 9» à * 9 6€ «* 994 9*4 4*9 4*9 4*4 4*4 99499-2899 


9 € * € 6 «* à € «€ * €& € 9 & « & & € * 6€ € 9 € 4 € € 94$ 4$ 9*9 0069 ಅಆ ೬ ೪. ಓ 9 à 9v à € v4 à 44 A 


ಇ € € € € € 9 € € 9 € 6€ 6 9 € 9 6 € * e 9 e 9€ ee € € € € € € € e e e e 9 € e € 9 € e e 6 * € 


oe >, 
s 


... 


o 9 0 0 0 0 


.._a«e ...e.s 
.. 


even ° 


9 
b 


ಕ ಬೈ A 


^ 9 9 9 9 » 9 9 


0 


»* b eo? ೨.6 ಕ್ಕಿ 
oe e 


b o o o 
9 


» A 
$? e 9 9 e 5» 5 € 


Check 


id 


m 


ICo 


ro 


« 


Cont 


= 
LU 
= 
0೧ 
> 
(n 
< 
O 
W 
= 
m 
= 
= 


D 


Y 
O 
Ul 
a 
O 
O 
z 
< 
O 
z 
< 
= 
= 
O 
O 
zi 
O 
ag 
p= 
z 
O 
O 


Enter your Log Onl 





0 
f JO 
೧. 
| 2 


Pana nur ara a a a a af a aa aaa a a a C ul PT SE a E Eu ET AUS A EE Wd UN 


in CCCS 


In Procedure of MainBook 


Figure 4.2 The Log- 


po 


ControlCommandCheckS stem 


D 
Z 
L 
= 
E 
«T 
= 


PersonRecords 


BarCode 


Customization 


UserRecords 





Figure 4.3 Main Menu For Full Users Of MainBook In CCCS 


Main Menu For Real Users 


b. 


level user (full- 


the system as a U 


After a user has been recognized by 


access users), the system grants him/her access to the main menu shown in figure 4.3. 


There are two buttons at the bottom of the screen: one is the "EXIT" button for exiting 


the MainBook, and the other is the "HELP" button which is an on-screen help explaining 


all the buttons and their related functions. At the upper left-hand corner of the screen the 


Current path appears. Finally, at the middle, the main menu provides six selection buttons 


to the user: 


* BarCode selection enables user to check an individual who is asking for entry/exit 


access, and store the specific entry/exit information; 
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e Customization selection allows user to select the colors to be used for background, 
foreground and text for personal satisfaction; 


e Intruders selection informs user if any intruding attempts to break into the system 
have been occurred; 


e PersonRecords selection transfers control to a menu for manipulating the database 
records of the persons who are allowed access to secured building; 


e Reports selection enables user to read/print reports about persons who currently or 
in the past have entered the secured building; and 


e UserRecords selection transfers control to a menu for manipulating the database 
records of all system-users (categories U, R and G). 


c. Main Menu for Readers 

Whether a user has been recognized by the system as a R-level user 
(read-access users), the system grants him/her access to the main menu shown in figure 
4.4. There are two buttons at the bottom of the screen: one is the "EXIT" button for 
exiting the MainBook, and the other is the "HELP" button which is an on-screen help 
explaining all the buttons and their related functions. At the upper left-hand corner of the 
screen the current path appears. Finally, at the middle, the main menu provides four 

selection buttons to the user: 
e BarCode selection enables user to check an individual who is asking for entry/exit 

access, and store the specific entry/exit information; 


e Customization selection allows user to select the colors to be used for background, 
foreground and text for personal satisfaction; 
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* PersonRecords selection transfers control to a menu for accessing information . 


about database records of persons who are allowed access to secured building (it 


is a read right only); and 


* Reports selection enables user to read/print reports about persons who currently or 


in the past have entered the secured building. 
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d. 


Whether a user has been recognized by the system as a G-level user 


(guards), the system grants him/her access to the main menu shown in figure 4.5. There 

are two buttons at the bottom of the screen: One is the "EXIT" button for exiting the 

MainBooK, and the other is the "HELP" button which is an on-screen help explaining all 

the buttons and their related functions. At the upper left-hand corner of the screen the 
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Figure 4.6 Accessing On-Screen Help In MainBook Of CCCS 
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shown. Second, the fields of a person’s record are displayed. Finally, the system requests 
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When a user enters the individual’s ID number into the system, the 
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found, system error, etc. Otherwise, the search locates the record related to passed-in ID 
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Figure 4.8 What's Displayed Whenever An Image Does Not Exist 
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The Screen 


izing 


Custom 


&. 


The CCCS prototype provides U and R users with the capability to build 


their own colored screens to their satisfaction. After the user clicks on the 


the screen of figure 4.11 is displayed. It is the screen 


button, 


"Customization 


in the upper left-hand corner the current path is 


customization menu. As in all screens, 


shown. At the bottom of the screen, there are the general purpose buttons "EXIT", 


The first two buttons perform similar functions as 


"DefaultColor" and "OK'. 
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HELP: 


previously described. The "DefaultColor" button is for getting back the system default 


colors. 
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A detailed description of the screen customization procedure is provided 


via the on-screen help, see figure 4.12. The user must first select the recolored item 


(background, foreground or text). Then by clicking on the color buttons in the palette, 


he/she can watch the selected item change color. The user must verify his/her final color 


"OK" button. After the user has built the color screen, by 


selection by clicking on the 


defining colors to the background, foreground and text, the user verifies final selection 


by clicking on the "OK" button, which recolors all the screens in the MAINBOOK.TBK. 


Then, the user returns to the main menu screen. 
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After clicking on the "Intruders" button in the main menu, the full-user 


Keeping Track Of Intruder Attempts 


h. 


e delete the file where the displayed intruders data is stored, by clicking on the 
"DelIntruderFile" button; and 


e return back to the main menu, by clicking on the "ReturnToMainMenu" 


hand corner. The text field contains information about attempts to break into the system. 
e print the displayed report by clicking on the "PrintIntruders" button; 


gets the screen of figure 4.13. The current path 
The provided information are: date 
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Finally, if an intruding attempts file has not been created by the system, 


an appropriate message informs the user that intruder’s file doesn’t exist, see figure 4.14 
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Manipulating Persons Database 


i. 


The CCCS provides write/read access rights to full-users. By clicking on 


the "PersonRecords" button at the main menu, a Real User gets the screen shown in 


figure 4.15. The current path, in the upper left-hand corner, informs the user that this is 


three general purpose buttons 


> 


the third level in the hierarchy. At the bottom of the screen 
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exist: to exit t 


he entire book click on the "EXIT" button, to get on-screen help click on 


the main menu click on the 


to 


button, and to return back 


HELP” 
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"ReturnToMainMenu" button. When the "ReturnToMainMenu" button is clicked, the 


system asks for the user's verification, in order to quit the menu of person's database and 


return to the main menu. 
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Figure 4 


at the middle of the screen, contains all the data 


The person’s record, 


related to PERSONS tupple, except the photograph. Above the person’s record, there is 


a menu to manipulate the person’s database. The menu incudes nine categories which 


perform specific functions. Each function is described in details in the following sections. 
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(1) Add A New Record. The "AddRecord" procedure is a loop, i.e., the 


system asks the user, see figure 4.16, if he/she wants to add a new record, until he/she 
wants to stop. If the user’s response is affirmative (i.e., he/she wants to add a new 


it requests data 


9 


the system automatically creates a new record ID number. Then 


> 


record) 


s record fields as shown in figure 4.17. If the user’s response is negative 
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to fill the person 


(he/she does not want to add a new record), the system exits the loop and returns to the 


screen shown in figure 4.15. 
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Delete An Existing Record. The "DelRecord" button deletes the 


(2) 


currently displayed person's record. To delete a specific record, first, the user must find 
it in the "FindRecord" procedure. The system always verifies the deletion of a record as 


shown in figure 4.18. 


button allows a user to 
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(3) Edit An Existing Record. The 


modify the currently displayed record. To edit a specific record, the user must find it in 
the "FindRecord" procedure, and then click on the "EditRecord" button. First, the system 
requests verification. Then, it informs the user that he/she must use the mouse and the 
keyboard to update the record fields on the screen. After that, it hides all the buttons and 
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Figure 4.19 Updating A record In MainBook of CCCS 
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Find An Existing Record. The "FindRecord" procedure enables a user 


(4) 


to locate and display an existing record related to the entered key. This procedure interacts 


with the currently active index (person’s ID number, SSN, or last name) as shown in 


the system asks user to activate an index and then 


9 


figure 4.20. If no index is activated 


"FindRecord" procedure. If an index is active, the system asks user to 


proceed with the 


the 


, 


enter the related key for the record to be found. If the entered key does not exist 


system displays the closest smaller number for ID number and SSN indexes, and it 


remains at the current record for last name index. 
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Figure 4.20 Finding A Person's Record - 
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"FirstRecord”, 


"LastRecord”, 


The buttons 


(5) Accessing Records. 


"NextRecord" and "PreviousRecord" provides the capability of accessing records 


according to the active index and to their location. Therefore, last or first record is 


the next or 


in the active index file. Similarly, 


considered the respective last or first key 


previous record is the respective next or previous key of the currently displayed record. 


is currently displayed, trying to get the previous or the next key 


If the first or the last key 


respectively will result in a message similar to the one shown in figure 4.21. If no index 


is active, the system accesses records according to their physical storage in the database. 
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is also a unique key, and last name 


SSN 


, 


(6) Indexing. The system supports three different indexes: person's ID 


two indexes are unique keys for each person. The ID number key is created and 


number, Social Security Number (SSN), and last name as shown in figure 4.22. The first 
indexing is not unique. Each time the user wants to activate an index (if no index is 
active) or to change to another index, he/she clicks on the "Index" button and selects the 


maintained by the system for each person 


desirable index. 
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Reading Persons Database 


J. 


The CCCS provides read access rights to the Readers (i.e., R category 


» a USET 


button at the main menu of figure 4.4 


"PersonRecords 


users). By clicking on the 


gets the screen of figure 4.23. The general purpose buttons, at the bottom of the screen, 


function exactly in the same way as those for Real users. The person's record, at the 


middle of the screen, contains all the data related to PERSONS tupple, except the 


photograph. At the upper left-hand corner the current level in the hierarchy is displayed. 


The menu to access the person's records in the database contains six buttons. Each button 


performs exactly the same operation as the respective same name button for Real users, 


we have described previously. 
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Figure 4.23 Persons Database Menu For Readers In MainBook 
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The first two categories of system users (U and R users), can click on the 
at the upper left- 


Reports 


k. 
select and display a report on persons who are currently inside the building, or on 


persons who have visited the building in the past; and 


select and print one of the previous reports. 


return to the main menu 


"Reports" button at the main menu and they will be granted access to the screen shown 
shown. Three selection buttons, at the bottom of the screen, 


in figure 4.24. Again, 
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the system does not allow to print 


9 


When the user clicks on either the "DisplayReport" or the "PrintReport" 


button, the system will ask him/her to select report, as shown in figure 4.25. The CCCS 
can display all the persons currently inside the building (Entries) or all the persons who 
Out the report on the persons currently inside the building. Whenever the "Entries" report 
has been selected, the system displays: the date and time of the entry, and the person’s 
ID number as shown in figure 4.26. If the "Exits" report is chosen, the system displays: 
the date and time of the entry, the date and time of the exit, the person's ID number and 


have visited the building in the past (Exits). However 
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Figure 4.25 System Request For Report Selection 


the person’s name as shown in figure 4.27. 
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Figure 4.26 Entries Report In MainBook Of CCCS 
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Manipulating Users Database 


l. 


The last selection button at the main menu for Real Users is the 


a user gets the screen of figure 4.28. 
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button. By clicking on that button 


11 


"UserRecords 


The current path, in the upper left-hand corner, informs the user that this is the third level 


down to the menu hierarchy. At the bottom of the screen, three general purpose buttons 


exist: to exit the entire book click on the "EXIT" button, to get on-screen help click on 


the 


the main menu click on 


button, and to return back to 


"HELP" 


the 


"ReturnToMainMenu" button. Notice that whenever the user clicks on a button to exit the 


as shown in figure 


3 


the system asks for verification 


> 


current procedure or the entire book 


4.29 and figure 4.30 respectively. 
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The system accepts the user to 


* 


The user's record, at the middle of the screen, contains all the data related 
s record to be updated, the system allows a user to use the mouse and the 


> 


user's database. In the menu, there are 8 buttons. Each button performs a similar 
operation to the same name button previously described in PERSONS database. When 


update only the three last fields in the user’s record (category, log-on id, and password). 
Updating of all other fields in a user’s record is done on the PERSONS database menu. 


to SYSTEM-USERS tupple. Above the user’s record, there is the menu to manipulate the 


keyboard to do all the changes as shown in figure 4.31 


editing a user 


oo © ee ee oo 5 
*,*,*,*,*,*,* ,*,*,* 9t. 
90696069 09909 99 9 5 


e^050 0.0.0 070 0.0 0.0 0 9 6. 
OOO 


NedRecord 
123123123 


è 
0.0 o o 


üdCheckSystem .. . 
FirstHecord 

Access Mode 

Log On ID.... 


Do the carrections on screen using the mouse and the 
DIKINSON 


keyboard 


ant 


o o © © © 
9 E a b 
e 9» 4+ 0 o e 


eee 
ee b 
b è 


e» 6 


". Gontrol Comm 


EditRecord: 


Recon 


03 


ನ 
i Ea sec 


9? 9 95 9 9 59 
La 
b 


AddRecord 


0.0 ¢ 6 
M 


Saca o de GE b bom b RAE e ನ. ಜಂ ಐ. 
. 


A 


. ಆ 
ಕ್ಕ ; 
9,9 
e. 
ಇ 
a 
a 
i 
ಕ್ರ 
a 


| 
, 
| 
| 
| 
| 
| 
| 
ಗೆ 
, 
b 
y 
! 
, 
| 
H 
i 
A 
1, 
ಕ್ಷೆ 
$ 
[4 
L 
LI 
H 
| 
| 
y 
ಕ 
y 
d 
\ 
t 
j 
y 
1 
L 
M 
! 
, 
? 
j 
2 
} 
| 
A 
i 
| 
i 
J 
| 
|J] 
b 
I. 
á 
LI 
14 
LI 
| 
| 
J- 
y 
[ 
| . 
| 
i 
J 
I e 
i 
ಕೆ 


Sa 
KA 
g 


HI. D. Number.......... 
Last Name 

| birstiome..................' 

i Middle Name.... 





59 


BarCode Book 


2. 


The BARCODE.TBK is used by guards, to enter entry/exit information. The 


loading of that book is done by voice, and as we have referred before, the use of a voice 


time versions of MS Windows and ToolBook. After the 


recognizer needs the run 


BARCODE.TBK has been loaded by a voice recognized command, the screen shown in 


figure 4.32 is displayed. The system, first, asks guard to enter the individual’s ID number 


(read by a bar code scanner). After the bar coded ID number has been entered, the system 


follows the same name procedure described in MainBook. 
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However, there is a difference here: after the system displays the person’s 


photo for 15 seconds, it goes back to person’s record and asks guard to scan the bar code 


ID number once again, see figure 4.33. In that way, the system allows guard to keep the 


s record being displayed as long as he/she wants. After the guard scans the bar 


> 


person 


code 1D for second time, the system will inform about the person”s entry or exit, update 


the related databases, exit the BARCODE.TBK, and return control to DOS (i.e., it will be 


ready for a new voice command). Additional details on the BARCODE.TBK screen are 
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3. Photo Book 
The PHOTO.TBK book is used as a database to store the individual's images 
and to manipulate them. Only Real Users can load this book and manipulate the person's 
images, enter a new person's photograph, or to update an existing one. In addition, the 


following tools are necessary: 


e 4 full version of MS Windows; 
* a scanner and its related software to scan and store the person's image; and 


* appropriate software to convert the stored image format to bitmap. 


Since the manipulation of photographs needs specific actions, the appropriate 


preliminary steps for adding or updating person's images are necessary: 


e the user has to scan the person's image and store it into the memory; 
* use convertion software to change the image format to bitmap; 
e after MS Windows is loaded, load the photograph into Clipboard; and 


¢ run ToolBook and load the PHOTO.TBK. 


a.  Log-On Into Photo Book 
After the PHOTO.TBK has been loaded, the screen shown in figure 4.34 
is displayed. The system displays the title, the kind of data it contains (i.e., images), a 
brief explanation of what it is, and two selection buttons. If the user selects the "EXIT" 
button then the system will exit the book after a verification. Finally, the selection of 


"LogOn" button will start the log-in procedure. 
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A user, who has been recognized at the login procedure 


to the main menu shown in figure 4.36. There are two general buttons at the bottom of 


the screen: one is the "EXIT" button for exiting the PHOTO.TBK, and the other is the 


HELP" button which enaples an on-screen help procedure. It describes all the buttons 


e" 


and their related functions as shown in figure 4.37. Whenever the user selects the "EXIT" 


button, the system will verify before it exits the whole book as shown in figure 4.38. At 


hand corner of the screen, the current path appears. Finally, at the middle, 


the upper left- 


the main menu provides three selection buttons for the user. 
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Figure 4.39 Adding A New Photograph 
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(3) Updating An Existing Photograph. The updating of a person’s 


photograph needs the same preliminary steps that have been referred to at the beginning 
of this subsection for both "add" and "edit" procedures. Therefore, after the user has 
loaded the new person's photograph onto the Clipboard, he/she clicks on the 
"EditPersonPhoto" button. First, the system asks for the person's name, as shown in figure 
4.38. Then, it locates and displays the screen of figure 4.41. Next, it asks the user to 
verify updating of the old photograph. If the user's answer is "yes", the system changes 
the old photograph with the current one onto Clipboard. If the user's answer is "no", the 


system returns to main menu without updating the person's photograph. 
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V. RESULTS OF THIS RESEARCH 


A. PREFACE 

This Chapter contains the results of the research. It is divided into four sections. 
The current section is an introduction for the following three. Next, Objectives and Goals 
section describes how the objectives, originally defined, have been accomplished in the 
CONTROL COMMAND CHECK SYSTEM (CCCS) prototype. Then, section Voice 
Recognized Commands provides the appropriate guidelines for using a voice recognition 
system. Finally, CCCS Performance section discusses the requirements that CCCS needs 
to run efficiently, such as CPU speed, memory space, and software packages needed for 


the preliminary work on photographs. 


B. OBJECTIVES AND GOALS 


1. The Multimedia DBMS 
The CCCS prototype manipulates the traditional person’s, user’s and entries’ 
databases. All of these databases use dBASE III PLUS formatted files (‘PERSONS.DBF", 
"USERS.DBF","ENTRIES.DBF”). They keep all the traditional information of individual's 
records (i.e., persons who are granted access-right to the secured building, and system- 
users), and person's entries. By exploiting the ToolBook TBKDB3.DLL library, the CCCS 
communicates and works with those dBASE III PLUS files, and manipulates their 


respective records (i.e., add, delete, or update). 
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The feature of ToolBook to recognize and manipulate any graphical data 
formatted as bitmap and the capability to transfer bitmap images from the Clipboard into 
ToolBook applications have been exploited to produce a database to store and maintain 
scanned images (‘PHOTO.TBK" book). Furthermore, the Dynamic Data Exchange (DDE) 
feature of the MS Windows environment, allows the "MAINBOOK.TBK" and the 
"BARCODE.TBK'" to send commands to "PHOTO.TBK". In such a manner, the person's 
image is displayed and is related with the person's traditional record. The existing voice 
recognizers, which operate within the DOS environment, activates the CCCS books. Voice 
recognized commands execute DOS batch files which, under run time versions of MS 
Windows and ToolBook, run the CCCS books. After exiting the CCCS, the system 
control returns to DOS. 

Finally, the current bar code scanner enter scan bar codes into the system 
which replaces input from keyboard. Each individual, who is granted access right to the 
secured building, owns a card with his/her ID number. Whenever the CCCS requests for 
a person's ID number, the scan bar code ID is passed in. 

Therefore, the CCCS prototype is considered to be a substitution for a 
multimedia DBMS, because it has the capabilities to manipulate data of traditional 
databases, scan images, accept voice input as well as bar mdr input. 

2. Using Commercial Software For IBM Compatibles 

The CCCS prototype has been implemented as a ToolBook application which 

consists of three books. ToolBook is an application tool that runs within a MS Windows 


environment. Both ToolBook and MS Windows are commercial software developed to 
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run on an IBM or IBM Compatible PC. The secondary dBASE II and ASCII files that ` 
support the three main books, are also results of software for PCs and can be edited and 
manipulated by PC software too. Also, there are commercial bar code systems and voice 
recognizers that can cooperate with PC software. As a result, the CCCS prototype has 
been implemented using commercial software and can be executed on a microcomputer 


platform. 


3. Satisfying Both Novice And Expert Users 

The BARCODE.TBK book is easy to use by inexperienced end-user, such as, 
users with only basic clerical skills in entry level positions. First, the CCCS is activated 
using the microphone of the voice recognition system. Then, the individual’s ID number 
is entered using the bar code scanner. Finally, the user checks the information provided 
by the system (i.e., the person's photo and record) to see if it corresponds to the 
individual who is requesting access. 

The MAINBOOK.TBK and the PHOTO.TBK books have been implemented 
with both experienced and inexperienced users in mind, although the system favors the 
novice. The Guards and Readers have to know, only, how to type a few characters (in 
order to enter the person's ID number), using the keyboard, and how to use a mouse to 
click on a button. The system has a fully graphical interface, that guides users through 
screens by enforcing them to click on buttons or type a few characters. In addition, the 
system provides feedback, error explanation, error recovery, and on-screen help. The Real 


Users need to be occasional computer users, since they have to perform more complex 
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jobs, such as, adding/updating a person’s photograph. The eight golden rules of dialogue 


design have been followed to provide a good user interface. 
4. The Eight Golden Rules Of Dialogue Design 


a. Strive For Consistency 

At the bottom of every screen, the following buttons might appear: EXIT, 
HELP, OK, DefaultColor, Return Buttons, Display Data Buttons, Print Data Buttons. 
The buttons appear in the exact same order and are in the exact same position. If a button 
does not pertain to a screen, it does not appear on the screen and the position that it 
would have appeared is left blank. 

At the top of every screen, in the upper left-hand corner, the paths taken 
to get to that particular screen are listed. 

When an individual’s record is requested, the information in the record 


is presented in the exact same order every time. 


b. Enable Frequent Users To Use Shortcuts 
If the user wishes to exit the system from any level, he/she might use the 
EXIT button to save the data and exit the system, without walk his/her way back up the 
hierarchical tree. 
Whenever the system asks user to enter some data, the use of ENTER key 
on keyboard is exactly the same as clicking on the OK button. 
A novice user can accomplish the task of adding a person’s or a user’s 


record, following the respective "add" procedure. However, an experienced user can exit 
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the "add" procedure after the system has generated the person’s ID number, and enter the 
rest of the data using the "edit" procedure. In that way, he/she selects and fills whatever 


field he/she wants saving time. 


c. Offer Informative Feedback 
As the user selects different menu options, the path taken and the current 
menu selection is printed in the upper left-hand corner of the screen. 
If an invalid input is made to a record field, the user is immediately 
informed that an unacceptable input has been made and what an acceptable input is. 
When the user chooses to delete a record or to exit system or to quit a 
procedure, a verification prompt is given so that the user will not accidentally delete, exit 
or quit. 
d. Design Dialogues To Yield Closure 
When the user is adding a record, the user is prompted for the 
information that is required for each data entry. When the end of data entry is reached, 
the user is asked if he/she wishes to add any more records. According to his/her answer, 


the system will remain in the add procedure loop, or it will exit. 


e. Offer Simple Error Handling 
When an error is made, the user is immediately informed as to why the 
error occurred and how to correct it. Generally, there two types of errors. One type is 


system-errors, such as system failure to open/close a file, retrieve/write information, etc. 
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The other type is input-errors; user enters incorrect data, such as letter instead of a 


number. 


f. Permit Easy Reversal Of Actions 
When adding a record, there is a pop up window with the data field that 
is being entered. When the user is completed entering the data for that field, he/she has 
the option of correcting any errors before clicking on the OK button, or delete the data 


just typed clicking on the Cancel button. 


g. Support Internal Locus Of Control 
There is a logical flow through each menu or each procedure to lead user 
to the correct screen. If the user can not remember to do something, there is a HELP 
button on every screen to guide the user to the next step. 
h. Reduce Short-Term Memory Load 
There are no codes to remember. The user just clicks the mouse on the 
correct button and continues on his/her way. 
5. Improvement Of Security/Safety Level 
The CCCS prototype improves security/safety level in many ways: 
a. Using BarCode ID Cards 
Having the individuals who are granted access to the secured 
building/area possess cards with only a bar code number on it, all sensitive data that, 


otherwise, would be printed on that card is hidden. In such a manner the CCCS: 
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* prevent the dispersion of sensitive information such as a person's name, rank, 
address and photograph on ID cards; 


* minimize the effect of a possible loss of the ID card; and 


e reduce risk of passing sensitive information to unauthorized persons. 


b. Three Categories Of System-Users 

The CCCS divides users into three categories providing them different 
access rights. Whenever the voice recognition and the bar code systems are used, the 
guards are only provided with these necessary equipments plus a monitor. So there is not 
a way to access the CCCS otherwise. If the bar code scanner is not available, the system 
demands the user to pass a log-in procedure, to access the system. Depending on the 
entered combination of logon ID and password, the system allows the user to access 

specific parts of the CCCS. The three categories of users (U,R,G) are enabled to: 
* Real Users can access and maintain all kind of data in the CCCS. They can 
perform any of the functions provided by the CCCS (i.e., they are full system- 


users); 


* Readers can only read the person's records and entries/exits. In that way they are 
authorized to check whether the guards accomplish their task correctly or not; and 


* Guards can only enter data about a person's entries/exits into the system and view 


the corresponding information of the person who is requesting access. They do not 
have access rights to other data stored in the CCCS. 


c. Check Of Illegal Entries/exits 
The system checks and keeps track of the correct sequence of a person's 


entry/exit (ex., a person already inside the building can not enter into the building again, 
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he must, only, exit from the building). Therefore, cases such as two persons with the 
same ID card trying to enter/exit the building, or an accidental or on purpose non- 


informing of a person’s entrance/exit might be detected. 


d. Encryption Of Sensitive Data 
The CCCS uses a substitution cipher technique [PFLEEGER 89] to encrypt 
sensitive information into "DBF" files, such as user’s logon ID and password. So, even 
if one of these files was penetrated, the intruder would not obtain the real code (user’s 


logon ID and password) to penetrate the CCCS. 


e. Formulation Of CCCS Intruding Attempts 
The system checks and keeps track of, in a hidden file, all the accidental 
or intrusive attempts to break into the system. The information of the intruding attempt 
consist of the date, time, passed in logon ID and password. The Real Users, (users in U 
category), of the system can view the intruders file, and get a print out of the stored 


information. 


C. VOICE RECOGNIZED COMMANDS 

The CCCS prototype has been designed and implemented to permit the usage of a 
voice recognition system. It allows Guards to run the BARCODE.TBK and enter 
information about person’s entries/exits. A speech recognition system associates every 
word in its vocabulary with a command or an executable file (i.e., files with extension 
COM, EXE, or BAT), in DOS environment. Therefore, every Guard has, first, to train 


the speech recognizer to identify his/her voice. Each Guard’s name, then, will be an entry 


T1 


in the vocabulary of the speech recognizer, and it will be associated with a "BATCH" file. 
That unique BARCODE BAT file activates a MS Windows environment, loads ToolBook 
(run-time versions for both of them), and opens BARCODE.TBK. An example, with 
Guard's name "John Smith" shown in figure 5.1, makes the whole procedure clear. The 
Guard enters the string "JohnSmith" using the microphone. The speech recognizer, first, 
identifies the guard's voice and then, it executes the BARCODE.BAT file. That file 
contains: the path which guides to the sub-directory of CCCS books (ie., 
CNtoolbookVleo\); and the programs that must be executed (ie, WIN.EXE, 
TOOLBOOK.EXE and BARCODE.TBK) to access the BarCode book. As a result, the 


screen to enter information about person’s entries/exits is displayed. 


ACTIVATION 
"JOHNSMITH" OF 
BARCODE 


SPEECH BOOK 
RECOGNIZER 


GUARD NAME 
SELECTION 
II "BARCODE.BAT 
MICROCOMPUTER 


CD \TOOLBOOK\LEO 
WIN TOOLBOOK BARCODE.TBK 





Figure 5.1 CCCS Activation By Voice Recognized Command 
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D. CCCS PERFORMANCE 

Last section in Chapter III presented the problems, the constraints and the 
hardware/software requirements for CCCS implementation. Now, this section discusses 
how these problems were solved, and how factors, such as the hardware capabilities of 


the platform, affect the efficient performance of CCCS. 


1. Speech Recognition Systems 

The voice recognition systems function within DOS environment. Besides, MS 
Windows applications, such as ToolBook, do not have capabilities to terminate MS 
Windows environment. So normally, the completion of CCCS books leaves the user 
within the MS Windows environment. Therefore, the problem was: after BARCODE.TBK 
execution is completed, how the system control returns back to DOS in order a new voice 
recognized command be executable. 

The answer is: using run-time versions of MS Windows and ToolBook. A run- 
time version of an environment is automatically activated and terminated by the beginning 
of execution and on completion of any application which is run within that environment 
respectively. Therefore, on completion of BARCODE.TBK the run-time version of MS 


Windows returns system control back to DOS. 


2. Efficiency Factors 
The minimum software and hardware requirements a platform needs to run MS 
Windows and ToolBook successfully were also presented in Chapter III last section. 


However, the performance of CCCS prototype on a computer system with an 80286 


79 


microprocessor is very poor. The main reason for that is the platform itself, since the 
current versions of MS Windows and ToolBook run very slowly on a platform with an 
80286 microprocessor. A good performance for CCCS is achieved on computer systems 
with an 80386 microprocessor with CPU speed 25Mhz or higher and 4MB or more 
memory. 

A main constraint for all multimedia DBMS is the large memory space 
necessary for storing a photograph. In CCCS specifically, the increment of PERSONS 
records in CCCS implies a proportionate increment of PHOTO.TBK database. However, 
since each photograph occupies a large amount of memory space, the size of 
PHOTO.TBK increases considerably. Therefore, a PERSONS database with a large 
number of records requires a large amount of available memory space for storing the 
respective photographs. So, since the increment of PHOTO.TBK database affects the 
efficient search of photographs database which in turn affects the overall CCCS 
performance, an organization with a large number of records in the PERSONS database 
needs to increase the hardware capabilities of its microcomputers to succeed better CCCS 


performance. 
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VI. FURTHER IMPROVEMENT AND RESEARCH 


A. AREAS FOR IMPROVEMENT OR ENHANCEMENT 

The commercial software packages do not allow important improvements in 
CONTROL COMMAND CHECK SYSTEM (CCCS). However, ToolBook provides 
the capability to manipulate sound too. The CCCS prototype can be enhanced to include 
sound, such as individual’s voice sample. The manipulation of a sound database has 
similar problems to photograph database. Since both types of data are created outside the 
ToolBook environment, specific preliminary actions must be accomplished in order the 
data to be entered into the application. 

A considerable improvement to the CCCS capabilities and performance can be 
accomplished, with further research on photograph and sound manipulation. The following 


section, Future Tasks, discusses those areas and proposes some tasks for further research. 


B. FUTURE TASKS 


1. External Graphical/Sound Data 
The CCCS prototype does not provide full manipulation of photographs from 
within the PHOTO.TBK database. The Real User must scan, convert the scan image 
format to bitmap, and load the photograph onto the Clipboard from outside the CCCS. 
ToolBook does not provide any tools to manipulate automatically graphical or 


sound objects which have been created outside the ToolBook environment. But, ToolBook 
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communicates and exchanges information with other programs or environments through 
the TBK libraries and the Dynamic Data Exchange (DDE) feature of MS Windows. The 
functions in TBK libraries allow ToolBook to create/access/modify dBASE III, dBASE 
III PLUS and ASCII (DOS) files. The functions code is written in C language. In order 
to increase the access and manipulation capabilities of ToolBook, new functions can be 
created and added into the libraries. 

So, the creation of a new TBK library with C-language functions that will 
enable Toolbook to manipulate external graphical/sound objects from within Toolbook 
applications is an area for further research. Operations that have to be performed from 


within ToolBook applications are: 


* to communicate with Scanner software to allow scanning of external objects; 


* to manipulate the scan object with the scanner software tools (resizing, cutting, 
turning etc); 


* to store the scan object in a file defined by the user; 


* to communicate with a format conversion program to enable user to change the file 
format into bitmap; 


* to transfer the final graphical product into the application or simply display the 
object on the screen; 


* to communicate with zip/unzip software packages to compress/decompress the 
graphical object files; 


* to communicate with programs that manipulate sound data; 
* to store the sound data in files defined by the user; and 


* to use zip/unzip techniques for sound data files too. 
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In such a way, the database of graphical/sound objects can be a dBASE 
II/dBASE III PLUS file which contains object file names. Since, this DBF file contains 
only traditional data, it can be indexed. Therefore, since the search time in DBF file is 
decreased considerably, the application overall performance is improved. Moreover, the 
use of zip/unzip techniques can decrease the memory space needed to store the 


graphical/sound data files considerably. 


2. Security 

The CCCS prototype encrypts sensitive data such as user’s logon ID and 
passwords. However, an intruder can access the DBF or ASCII (DOS) files using a 
commercial DBMS that recognizes such files or an ASCH editor respectively. Therefore, 
although the imposer can not read the logon IDs and passwords, he/she does access all 
the other information in those files. A try to encrypt all the stored data in the CCCS 
results to worsen the current brittle efficient performance of the prototype. 

After the overall performance of CCCS prototype has been improved by the 
previously referred studies, the provided security of CCCS can also become better. Instead 
of using a substitution cipher technique to encrypt only the logon ID and the password, 
a more complex technique can be used to encrypt all the stored data. This overloading 
increases the total amount of time needed to retrieve/store the traditional data. However, 
with faster microcomputer platforms and better CCCS performance in manipulating the 


photograph and sound databases, it might be affordable. 
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